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Abstract of KR 20010076789 (A) 

PURPOSE: A multi-modal Internet interface device and a method thereof are provided to dialogue to a 
computer by a voice and to perform a web browsing by appending a voice interface function in a 
currently used web browser. CONSTITUTION: An MXML editor(312) makes a user prepare an MXML 
document using a template library by operations(31 1). A multi-modal Internet server(310) stores a 
prepared MXML document and includes an MXML document server providing the MXML document in 
accordance with the user. An MXML browser(321) is connected to the multi-modal Internet server 
(310) through the Internet, and interprets the MXML document and showing the contents of the MXML 
document on a screen and outputs a voice compounding message and prepares a voice recognition 
engine. A voice/compounding engine(322) performs voice recognition or a voice compounding. A TAPI 
(telephony application programming interface)(325)/MTAPI(multimedia telephony application 
programming interface )(326) provides an interface in an access to a multi-modal Internet client using a 
telephone(330). An l/0(input/output) device(324) comprises a keyboard, a mouse, a monitor, a mike, 
and a speaker. An I/O interface(323) provides an interface among the TAPI(325), the MTAPI(326), 
and the MXML browser(321 ). 
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£ 2fe MXMLSl 7H^£ 

310 : fflE|H& ejE^ AHHH 311 : ^affl 5|-0|Mfr]E| 

312 : MXML gAH AHhH 320 : fflE|H& £jEHy! #E^|£jm 

321 : MXML MEff^ 322 : ^M9}Mm^ <2!!£J 

323 : I/O eJEflUlOl^ 324 : I/O 3*| 

325 : TAPI 326 : MTAPI 

330 : EM 331 : ESF 

332 : S1E|0|C|OH 

e wse s#e-m aissm ejEj^g Ai-sa tin 7i£si u^*,, ?im=. au&i s§ oisefe smoa 
oh ejejyis o\mm ¥ aw sfe m mm aunt sjoiq-. 

2}Vj* SffElZhsl £iEHm|o|^S mmM t^Hfe ?|M=, §f ^ Al-SSl-n 2Jx|eh ?}Z}o\W\ MEh x|-oH^eHg 

tftffi eJZhZKHI o|D| KBo\jl ?Jfe ojgtfe WBoicK 

o|&m SfSS o|a| a|££Jji j^ieh S#e|s| 3¥ A|-»zha| qw-S}^ cha.7)| u|g# o|sHsfe 5!o| 

UjI tu-^S U|gs zlcWsL gx\& u^oH zl mgoi 7|M<=£ £J^S 5^ 5fo| em^n 2fe ^e||s §^ o|®H^I 7| 

ah 7i#^^o^.- u^oi goKHWfe- m7^nji omn*\ sjif a-oi *m@ eow-m 7^*fck 

g^S o|««KH S#eM cflSWfc 7|^o| Bto| A^slfe ARS AIAH0|CK fjAHb ^ Sg»g# *SH S#eH 

7i- AUKHiTij miAixis ?n Ahife asj7isi ^ &m oisshh ^jsfe sjts sb-^ji sick m^oi^ ekh a! 

^e)|o| g^ojAi 7 |^° gtwoj AHT£ 5cA|-fih p]fc!<HI o|S^<H s|£S A|^g|S£ ?H 

je|(H ot S£ g^g o|*e ais*o| ^eH« 5>^i ?JcK 



ZlSHLh ARS Al^glSl 7|&^oj &Afc SSte 8MH AH H| AS °J7| flsHAHfe «EHo| tH|^ ME|S CQ-Bf 7h0f= 

fi-O-fe 5Jo|cK eh5AHo| ars Al^ljoia 7|*Ni^« sH H AUTSS ttJUxlEh fitffc SMU- AHb|^s °J7| ^IbHaH 
g^ojA|° olgshfe g^ofe S= SHI gAfe sHa£|A|°h 0^^| Dll^f ^-BlM 7H*Ho|= ff-cfe &A|| 
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ARS AlASj^l SE °-*| OHl^ZL iff^Sl S*l|£. &C r fe 20|Ch. 0|^ff S« SHatl-71 ^i§H ARS 

7|eh Al^BjJlf ARSO-fl Ahgilfe Cljfr £i 2f DHItt ME|S &E|«ffe VXML( Voice extendable Markup Language) § 
IBM, AT& T, Motorola, Lucent §0| 7Hif gO|c|-. VXML-8- HTMLUr ftM® t^Hl 0[3.<li £jo-|S 0\gt[oi d\\tt 
MB|g =^»rS VXML AH bHcH| AH VXML gAHS AHU|>^ © r fe «EH0|Ck. D r *| HTML ^AHS EhStH H S>sB 

<y*l|tH| MlH m AHbH g°l AHHl^fe 11 £A|j <gd*||cH|AH 4=«s r fer 54 Si-c*. 



OlSF fSS SE Cr5 A|£^ Q\-0\3.sL£i2.M.A[Q\\M XH°h£r BfSO| &!feCH| ZL Ujge ARS AU*^« AhStf OH £d§r E!" 
S Mfe 50| Ohu|Er §A[0i <a^SfO=| ARS Dfl*f MISS 3t«<H| £0=) ^ 5Efe S#^o| D r ^A, 

*|ME. S« AfgSKH ttf jy7H| ©H= 5J0|CK 0| Ofl ARS D]Hfr°| ^jfle HTMLHj- #A r # »4J* Ahg*H^. 0^ 

0|a££ = mA|-°| tU-go| go 7)5 ARS A|^ajo| 0Wa «Hgst7| $|«H S#E-j go| £|-i£oJ| DHI^T ME|°| L||§S L+E|- 
Ll|0H tHIJfr M.BI [d/B r 7r7|g tWI ^Ch S^lEh 0| tf3 <^A| M%W g#E|S| n^^, ?|M = g« AF»«KH 



tfaOl Offal* sfe 7!fi^4 UMi 

^-7i& ssh 7i^ai *na*i-7i ?iEh e atse 7issi n mep-^-schiah s^eiE^ioiA 7i^s ^7^oi g# 

EH2h S^o^ cHSr^QH n MEr^SS ^SS 4 §rfe -SEl^Sf £]EH^ oj^E|j 0 |^ §y arftjg 

0|H ^|©h0={ e IhSCHlAHfe 7|£°| HTML gAHcH| C|j^ Elf ^7h§rb WtiBr ^ AHH|^ «A] ^ g#E|£|-o| cH§ r °-l| 

ah g^ej^s- flff ejoH ais eae Ah-g^tr 5s m. 

0|€r, UZ.Z[Oi m #Ai|oh7l| gtfch 

EIAH 7|£2| {Uj ME r °-S0H|AH g^S ^7 r ^ Ahgtf 4 ?Jfe A|^H0fl CH§H 7|#*hCh. A|^^)o| 0 fe £ 1 <Hj ^Eh 

LHS^ch, 

0|£F a-0| S^fi- ArSth 4 Al^BIS ?-ySr7| ^|®H 7|gfiJ HTML gAH(H| ¥M« ^n® BE|H@ X 

ML(Multi- modal extendable Markup Language: o|Sh MXMLEt IT) UAH* 

MXML ^AHfe smsj S AH CH| HTMLSI LHS2|- cH|e|- eHzl( Meta tag) S Ol^SS-oH So XMLS-I LHSS H"77l| 7|^# 5 
0|Ch g^g 4 MEh¥AiCH|AHfe XMLSI LH^S UUffiS ejEiJ£f|0|>i# X|^Sf7H| E|H ZL^X| 

**f- g^ofe s-y s an LHse ^ai^wi aa. 

Oil 5. 2S| MXML ^AH ^H^EM Ste*r(H S EH X r A)|t r 7HI HjdSffCF. 



£ 2fe 7|£2J HTML4 XML 3! CHS r ^E|7|- 0H^7H| 3&£|0H MXMLM ?««tfex| -agSjjl ? A [ CK 7|£S| HTM 
L°| □h^fil- 7|M^« SI^-frBoS A|-StfJl t^°Sb S r 0CH| a|^M, □LBU ^El^HS Sad S^Hr 

§?m ajcK oi s^o| s^&^« on_u ^ss g-s* a»si g*psF a-e a- 

^O^. fi^SMI SC|-. 7|^CH| Al|ohE| §^ XMLg 0|«Sfe S?f 7|g^|o^ 7 r SS|-Di SSH S©H S"SS 

0 J s ^fU 0|» S£ eJ^SrO^ *iE|»|-7H| SCK 5E SSr7|o| ?|nHc» 0 |gsH DTMF ^Js£ £WrO=j Ahg^Ch. 
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Sb n& S^o| ft<Mtlc\. o| ccH Mgxhb gsll StFb SMI £j7-m oflar 52| s)-fclS SMi o|» *H 

Bi«Ffe s#E=isi-°i qisi-&Ei7h iia*i-cK se 2oiah ^gsjk mxmls oie+& 7issj ¥ 7hxi s-fl* mwoi 

°Jmmo\ 7^8fa ti«|S4©S 7|fic, S ^o| *l|§JE|b B^WM, X||§E|b C^tf ojfte=| A |. 



SHCHIAH M*0|, 5f«aH BhO|MB1B|(311), £M S|-ffltt U#5J E|-0|M&{E|(311)« 0|SS|-<M A|-gX|-7|- MXM 

L SAHS ST^tt 4= fhfe MXML 11971(312), Sfgfi MXML gAHS AtgX}£| o S o| ®E[ MX 

ML bAH« Xl|§^b MXML bAH AHd-|S BJEIHS- ejE^l A-]b1(310); #7| fflElaS fcjEfy! AHHH(310)S* 

oj^yio^. <y^£|cH, MXML bA~|# §H*1t|-0=j HTML U)Se ShtftHj tjiO=j ^JL g£j XMLLHSS SH^^O^ 

tr oiiAixib ojgsFoH tjgsKH ^b mi £]emioia» s*h «3 ^ji, s& 

oHHUS o\gz[oi S^ej^ eulsm A r gx r 7h gtgfl- lH§S £H©|-o=| XML&II x|SS S^S 4 

MXML MB^XH(321)SK #7| MXML ME r ^*t(321)S| S.=?-0\\ Dj-Eh S^ei^l 5Eb S-gif^g ^Ssfe S 

•y pJ-^/ir^ ^3(322)4, =EISK330)» o|gs r o=| Se|sB £!eJ^ ae(.ol°HEo|| gesl-b g^cHj £jElj*)|o|^s x||g 
€fb TAPI (Telephony Application Programming Interface : 325)/MTAPI( Multimedia Telephony Applicatio 
n Programming Interface : 326)2]-, 7|M = , o r ¥^, SLjEj, nK>|.a, ^slt|5H gfij |/0( input/Output) &-*|(324) , 
#7| TAPI(325) §U MTAPI(326)2|- #7| MXML ME|-^X-|(321) S*°l £jEHa|jO|^S Xflgf|-b I/O <2JEHEi|Ol^( 323) 
• lt«tc SElsg- oJe^l^I SE^O|OHE(320)^ ^SCh 



SE|air ojE^yi AibH(3iO)b 7|S°J a AHbHsj <^sr* sfe 5!o S MX ml aS<H| u r s|- x{|§sH ?b <^if« 

»C|-. ttE|HH- ejEjyj AHU-|(310)^|b MXML bAm X^E|bd| 0|b MXML fflSJ7|(312)S>F *r^S E(-0|M 
5HB|(311)« 0|g§H 5[^§h>|| m. MXMLSl S¥ SifiJ- HTMLBf- SBj eJ^^ ojO-jH^JS ^OHo|= 
thfeDil oib 9joH *HE|<H| cH» SS^ieJ xHS S?tr°^. UBh HTML ^-Sxh7h ^^sh7| ohhcF. o|EH& ex^M §H 

fl^H A^X^h bS- H X^IB £f 7|#frb ttfih SSO| Q EJ-7=I| ^|SJ D||Ef. fB4 sr^s 



SE|HS eiE-j 1 ^ ashO| 1 2jM(320)b 7|^°| PQWS( Personal Computer/Work Station) 2h ^0| CPUS 9^7| 
0|C|-. MXML* sH*j*HAH Sl-etHI MO^ ^b MXML MB^^(321)fiH eJ^I/lf^ ?!!S(322), I/O 5f 3t|( ?|M=, Oh 
HL_|E(, D r O|H, ^H|7H§ ; 324), TAPI MTAP2(- MXML MBH?*|(321)fiJ-S| 9JE^-||0|^ Si, ^ I/O PJ&j 
iH|0|^(323)» 7I-XU oiEK 



MXML ME r ^Xi(321)e S^S MXML ^AHM °jEiy!S g§H 'fiElH^ PjBji^i AHbH(310) OflAH X||5^0K o|* SH^ 
^rO=| HTML Lljge 7|SSj «| MEh^X^^ SF°j( PC/WS°| £LjE| £Eb ^a^! S/eJEjy." #CH^£| §r^) OH! fi 

o=| ^cK zlelh xmllHS^ sH^ol-o^ S-y tr^# tH|A|x|b ■a!5JS olSSHH IT^g sfl AilsH, tap 

1(325) Efe MTAPI(326)S *«H SB^ ^J^ft '^O-jH'ag 0|g^ r 0=| S^eJ^ ^U|« r jl A|-g 

x^h tf^fl- g^o| oja|^oH m& XMLOil xISS gsrs ^«ecK 



TAPI ( 325) H[ MTAPI(326)b A-II32.I S4:0M SSK330)Sf BE|SB ojEj^i ^EfO|ojE( 320) • 0|g3tCH 2JB\^ 
5HSh(330)Sb A|-S£ib &1t7\S. A^# ^ ?Jb S«SSS^(331)SH ^3.h|§ 7^X|TL ?j0^ iA|£ 7h 

feth A3@ ft, ojE-i^ #cH$ gs| ttE|n|t|o|^(332)S ^ ?JcK fflE|D|c|o^Sh7|(332)«HI cHtHAHb 

Stiffs OrMEh HTML°| L«g£ 5f0| MU| gc|-. 
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£ Bid-, a SoH^si 3^ofe s-oh S£ofl cchEh ?|ms, d^A, au|^ Mgshxl «» ^£ BW. o|5H*h 

Spoilt ^iMfih dK)|=l» o|S*h<H sthb sf«a* «Hj= S£ ^gfl- 4 s aid-. 

XML°| Lflgoll cH«H tfBftch 



S£j XMLS) Sff EjS* Af-gXph X|-#££ Sgft 0|«SfO:| C|)^S L^CH A^Xph S 

#eHS s^a tfb 5Jo|cK o|S flaflAH §£! XMLOfe A|-gxh£|- S#&|7h Ufe 4= &!b Oj^oj lHSS 7| 

^nn Eifeoii e a-ggoHUHfe oi# mm a^skh 7i#^s* s-a-. g-s xml°i uigo^i= g#^oiiAH a^§ 

XW-il XH|S#b Ah«A[7l- tf&tt LHSS 7[^& CHI E|- ZLEU 0^ g§H A^X^o| oj E - O^t^L 

olofl cche gsfSI xisol aJcH. 



miEi- bSo^ n-e 7is°i <yo-|sy°i eaac* & b^oiEfe s|d|o|ck a\m bse ¥ 7ms. u-^lb 



5f<Utf fiss! E|-o|M£HBlb iatHlsf, 7|*MEo|DHai a-o| n xh*l|s shul-oj KhoH 0 | S-SH 4- &b SEHoid-. sf WBh 
Btoi Ah SHI b srsjoi CHS b'flS 7|fi*KH *e 50|CK MXML Zt&Xlt: XML°I L-HSO|| SH&£lb Sftt 
"gl^ 1 BhOlMBHEl tt^oj m \ m XlSSfe 5 D JO£ S#EH7|- AFgX^ C||SW<*| Ah^XF7h ^SiS 

4* &jm e-d-. srsjB mmm bfoimeheis xisa oh h^diem ^<h sa gom jg @ gsi 7^*1°] sm 

• t« 4= S!cK sr?d xisf^oj yel <Meh soflAH §1^°^ Ahgsjb g^ofl EhoiME-(E|o| g E n^ bAi 

x^7^ ohy xii ^^ 7 ^ a_^ 0 -\ 53* ^ o Jfi ^oich. 



o\o]\ &^oi x^ d||^ CHH-2J S cH ^& ¥»cH| n A^§xfo| 0 |gs ghoKHb cHSW 

= ai, y-*4 g« aohuib chshph §H&@ck o| <Hfe q-gah acK 

oil) 

get_data( cost umer_name) 
get_data( credit_card_number) 

xiiytu ?jxieh 01 ehie|- g^cnib AhsxFs* sH&ab ^nm twmm a¥o-i ssi-fe smi ?joh lhs^ 

S^&cK A|-gxh7h stj&SLlb cH§H ^b ^HS^SJ CH¥^£| i^S *HE|tf ^ fl-c*. 

If SSI A^t 

ti[9.[ S-b t* a 8 hl Se 7|£sj oie\^ me|-^Sch|aH ?|M = , nh^, au|N §°| £JNEilo|>i gj-Aj o|fi|o« Afg-cH| 

n BEiff s^g ejEHmioi^ ^7htr^AH mch sei^i ejEH^ MEh^s^ « ^ ?jck 01 an aish°i 7m 

sj JiSS ifi^f Al-S^b S, h -^o| oH_|Bh iH|e|- 7|feS SSH ?fj£lb ^Jfe^fi-cHlAH Ahgsfe SeHs.| 

o|^o|AH & tfgofl CHS 7|*A^hg AH^^S5x|°> o|b & ^Sal uHf^& 4JA|o||fl- o^A|^o S ^ 

St!" 5olx| s yg§ estfe ohulcK SE£h o| 7|$Soto| #^oj ^|ai§. 7 ^ ^Ehffl ¥?M- S ^SSI 7|# 
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(57) «?S| Bfl 

s^s- 1. 

7|go| q^^, ^ims, aui^ §» oigsfe ^ s>N m^m mmME. ahui^^i- 7\^s.m sfe beihs ej 

Ely! °JEHE)|0|^ 3*|0fl OJOUH, 

5j-«aa H*3! E|-0|MEHE|2h #7| SftiS EK>|MEHE[« 0|g£|-0=| Ahg^7h MXML SAHS 2f^[Sr 4= 

^•b MXML B5J7I2K §U 5f«S MXML gAHS *H5WoI AhgT^oj ffi«(H| CChBh MXML gAHS fll^fe MXML gAi 



a(- 7 | .jeihS ejEjy! ahum ei^ss. ^il£|cH, mxml £ah» «n*mo=| html mse sfboii Mo=j ^jl gs x 
MLLHSS *H*I*I-<*I §S tfStf DflA|*lte g£ fl-g o|g^<H S^«h<H sfe SSh £J&|Ej|o|^e gt?H 

S£=| ^S ?l& tjo-laas o|S*M g^£J^ <EJ!3§ Sh|«Fjl AhgxW tf^fi- S£joj L|)Sfi £i^o=| 

SS XMLO^I S^ h S MXML MEf^^Sf, #7| MXML M£^X-|°| s^ofl §S2J^ SEfe 

ss §s ej^i/fl-a ssepk as« oigsw aeiag sjEHy sstoiej&ofl g^si-fe g^<*i °jeh^ioi^* 

*llS3fe TAP! SI MTAPI2K D[0\H., I/O S*|£h &7l TAP! I 1 MTAPiUf &7| MXML ME^ 

^aHS-sl ojE-woi^s AllSshfe i/o QjEHsiiol^s alf§l-fe se|s& SJe^ aEhoieiMS. ^SElfe 5f I|§o^ 



2. 

7IS2I □F^, 7|M = , fiU|EH §§ olSSFfe 5 SI (HI S^IAHE. £JE^ AHbJ|^7h 7|*tfM, 

HTML gAHOll S-y XML ¥SS ^7^0^ MXML ^A~i# Sf-gSl-jl, 

§S XML°| LN§°S. S#^0flAi A^^OiMI AHlSSfe ^ A^X^ tf^fl- U|§f 7|ftff lH|Ef SB, gj CH|E+ §S 

« 5«H AhS^o| o|^s olsimji o|<H| gsfoj a»sM §J Sf£« S«H a-|u|^7|- 7fe^£ 

^ 3. 

S-S XML°I LHSe n ©H-i-sl 5|2joj 4 ?Jb SeHoi si-y xllf^oj 5f<y cHiEl- -^SS Ah§sho=| 

7|^shJl, 

A(-gA|£F sH&£|fe ^^|S *J1 LHShS U-^Oi Stfe SMS ^0-|y ^S7^ glfe A^X|-7h sH&Elfe ¥^o« cH 

E. S 
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tT-H^^cHI 7120 
2324 5568 8184 ^ 
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